Immersive display and method of operating immersive display for real-world object alert

ABSTRACT

An immersive display and a method of operating the immersive display to provide information relating to an object. The method includes receiving information from an input device of the immersive display or coupled to the immersive display, detecting an object based on the information received from the input device, and displaying a representation of the object on images displayed on a display of the immersive display such that attributes of the representation distinguish the representation from the images displayed on the display, wherein the representation is displayed at a location on the display that corresponds with a location of the object.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to and is a continuation of U.S. patentapplication Ser. No. 16/544,754, filed Aug. 19, 2019, which is acontinuation of U.S. patent application Ser. No. 14/818,119, filed onAug. 4, 2015, (now U.S. Pat. No. 10,389,992, issued Aug. 20, 2019),which claims priority under 35 U.S.C. § 119(e) to provisionalapplication Ser. No. 62/033,515, filed Aug. 5, 2014, which applicationsare expressly incorporated by reference herein, in their entireties.

FIELD OF TECHNOLOGY

The present disclosure relates to immersive displays such asthree-dimensional (3D) displays for displaying virtual or augmentedreality environments.

BACKGROUND

Immersive displays are becoming increasingly popular for the purpose ofplaying games in a virtual reality environment. These immersive displaysmay also be utilized for applications other than gaming, including, forexample, augmented reality applications. The virtual world oraugmented-reality is currently commonly perceived by the user based ontwo images, with each of the two images displayed close to a respectiveone of the user's eyes.

Such displays are often head-mounted and in many cases block out some orall of the real environment around the user in order to immerse theuser, for example, in the virtual world. Thus, these displays mayobstruct or block the user's vision of his or her surroundings.

Improvements in immersive displays are desirable.

SUMMARY

According to one aspect, a method of operating the immersive display toprovide information relating to an object is provided. The methodincludes receiving information from an input device of the immersivedisplay or coupled to the immersive display, detecting an object basedon the information received from the input device, and displaying arepresentation of the object on images displayed on a display of theimmersive display such that attributes of the representation distinguishthe representation from the images displayed on the display, wherein therepresentation is displayed at a location on the display thatcorresponds with a location of the object.

According to another aspect, an immersive display is provided. Theimmersive display includes a body, an input device coupled to the bodyfor detecting objects in region outside the body, a display on theinside of the body for displaying a virtual image thereon, and aprocessor coupled to the input device and to the display and operable toreceive information from the input device, detect an object in theregion outside the body based on the information received from the inputdevice, display a representation of the object on the virtual imagedisplayed on the display such that attributes of the representationdistinguish the representation of the object from the virtual imagedisplayed on the display wherein the representation is displayed at alocation on the display that corresponds with a location of the object.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the present disclosure will now be described, by way ofexample only, with reference to the attached Figures, in which:

FIG. 1 is a simplified block diagram of a of an immersive displayaccordance with an example embodiment; and

FIG. 2 is a flowchart illustrating an example of a method of controllingthe immersive display in accordance with the disclosure.

DETAILED DESCRIPTION

For simplicity and clarity of illustration, reference numerals may berepeated among the figures to indicate corresponding or analogouselements. Numerous details are set forth to provide an understanding ofthe examples described herein. The examples may be practiced withoutthese details. In other instances, well-known methods, procedures, andcomponents are not described in detail to avoid obscuring the examplesdescribed. The description is not to be considered as limited to thescope of the examples described herein.

The following describes an immersive display and a method of operatingthe immersive display to provide information relating to an object. Themethod includes receiving information from an input device of theimmersive display or coupled to the immersive display, detecting anobject based on the information received from the input device, anddisplaying a representation of the object on images displayed on adisplay of the immersive display such that attributes of therepresentation distinguish the representation from the images displayedon the display, wherein the representation is displayed at a location onthe display that corresponds with a location of the object.

A simplified block diagram of an example of an immersive display 100 isshown in FIG. 1. The immersive display 100 includes multiple components,such as a main processor 102 that controls the overall operation of theimmersive display 100.

The main processor 102 interacts with other components of the immersivedisplay 100, including, for example, a temporary storage device 104, amemory 106, a display device 108, a speaker 110, an auxiliaryinput/output (I/O) subsystem 112, external cameras 114, one or moreinternal cameras 116, one or more microphones 118, anorientation/movement sensor 120, one or more proximity sensors 122, acommunication subsystem 124, short-range communications 126, a powersource 128, and, optionally, other subsystems 130.

The temporary storage device 104 may be, for example, Random AccessMemory (RAM) that stores data that is processed by the main processor102. The memory 104, such as flash memory, is utilized for persistentstorage.

The immersive display 100 provides video output through the display 108,which includes an interface, a controller and at least one display todisplay images. The images displayed may be an image in front of atleast one of the user's eyes or may include a respective image in frontof each one of the user's eyes. In addition to the display 108, outputis provided via the speaker or speakers 110 or other audio output suchas headphones or earphones. The auxiliary input/output (I/O) subsystem112 includes an interface through which, for example, a USB controlleror other peripheral device may be connected.

Input to the immersive display 100 may be provided via the externalcameras 114 mounted on the body of the immersive display 100. Theexternal cameras 114 may include multiple cameras to obtain imagesextending around the user, i.e., 360° around the user. The externalcameras 114 may also include cameras to obtain images in an upwarddirection from the user, and in a downward direction from the user. Eachof the external cameras 114 includes the functional components foroperation of the camera, including the lens, the image sensor, and,optionally, a light sensor and light source, such as infrared lightemitting diodes (LEDs). Thus, the cameras provide images of the user'senvironment or surroundings. The external cameras 114 may be one or moreof visual light cameras, 3D sensing cameras, light field cameras,forward looking infrared cameras, near infrared cameras, ultravioletcameras, or other imaging devices. The external cameras 114 mayoptionally include one or a plurality of lenses that are corrected for auser's vision such that the image that is displayed on the display 108of the immersive display 100 provides a view that is corrected for theuser, thus enabling the user to view visual images utilizing theexternal cameras 114 without use of eyeglasses or other correctiveeyewear.

The terms upward and downward are utilized herein to generally describedirection of view of the external cameras 114 relative to the user whenthe immersive display is worn by the user and the user is in an uprightposition, and such terms are not otherwise limiting.

The one or more internal cameras 116, also referred to herein as theinternal camera 116, may be mounted on an inside of the body of theimmersive display 100 and includes the functional components foroperation of each internal camera, including the lens, the image sensor,and a light source, which may be a light source in the non-visiblespectrum, such as infrared LEDs. Although the interior of the immersivedisplay 100 may be dark because exterior light is blocked out orpartially blocked out, the light source provides sufficient light foruse of the internal camera 116. The inside body of the immersive display100 may be configured with a light source operable to provide sufficientlight to illuminate the eyes of the user to enable eye tracking or oneor more other eye condition evaluation operations or both eye trackingand eye condition evaluation. The light source may be configured toprovide spectral light that does not interfere or presents very littleor no noticeable interference with the user's ability to view imagesdisplayed on the immersive display.

The one or more microphones, referred to herein as the microphone 118,may also be mounted in the body of the immersive display 100 to provideinput by converting audible information to electrical signals, which maybe processed by the main processor 102 and may be transmitted to anotherelectronic device to which the immersive display 100 is coupled. Forexample, the immersive display may be coupled to a smart-phone, a laptopcomputer, a tablet, a desktop computer, a game device, and any othersuitable electronic device. Thus the speakers or other sound generatingdevices in such other one or plurality of electronic devices may be usedin association or coordination with the immersive display 100.

The main processor 102 also receives signals from theorientation/movement sensor 120, which is coupled to the body of theimmersive display 100. The orientation/movement sensor may be, forexample, an accelerometer, a gyro sensor, or any other suitable sensoror combination of sensors that is or are utilized to detect direction ofmovement, direction of gravitational forces, and reaction forces so asto determine, for example, the orientation of the immersive display 100and the movement of the immersive display 100. Such orientationinformation may be utilized to enable recording of sound by themicrophones in coordination with visual images to provide a morerealistic immersive experience for the user.

The one or more speakers 110 or other sound generators, referred toherein as the speaker or speakers 110, may also be mounted in the bodyof the immersive display to provide sonic by converting electronicsignals into audible information and such electronic signals may also betransmitted to another electronic device or plurality of otherelectronic devices to which the immersive display 100 is coupled. Forexample, the immersive display 100 may be coupled to a smart-phone, alaptop computer, a tablet, a desktop computer, a game device, and anyother suitable electronic device. Thus, speakers or other soundgenerating devices in such other one or plurality of electronic devicesmay be used in association or coordination with the immersive display.

The main processor 102 also receives signals from theorientation/movement sensor 120, which is coupled to the body of theimmersive display 100. The orientation/movement sensor may be, forexample, an accelerometer, a gyro sensor, or any other suitable sensoror combination of sensors that is or are utilized to detect direction ofmovement, direction of gravitational forces, and reaction forces so asto determine, for example, the orientation of the immersive display 100and the movement of the immersive display 100. Such orientationinformation may be utilized to enable generation of sound by the speakeror speakers in coordination with visual images to provide a morerealistic immersive experience for the user.

The one or more proximity sensors, referred to herein as the proximitysensors 122, may provide additional input to the main processor 102 todetect the presence of objects that are near or proximal to the sensorand thus to the user when the immersive display 100 is in use. Theproximity sensors 122 may be any suitable proximity sensors such as acapacitive or photoelectric proximity sensor. The proximity sensors 122may be connected to the main processor 102 via wireless connection, forexample, via the short-range communications system 126.

The communication subsystem 124 receives signals from another electronicdevice and sends signals to the other electronic device to which theimmersive display 100 is coupled. Thus, for example, the signals fromthe microphone 118 or signals from the external cameras 116 or from theinternal camera 116 may be sent via the communication subsystem 124. Thecommunication subsystem 124 is also responsible for receiving signalsfrom the other electronic device for processing by the main processor102 to cause images, which may include video, to be displayed on thedisplay 108 and for audio to be output through the speaker 110.

The immersive display 100 optionally includes short-range communications126 to perform various communication functions. For example, theimmersive display 100 may include Bluetooth or infrared (IR)communications capability, for example, for communicating with aperipheral device or accessory.

The power source 128 may be one or more rechargeable batteries or a portto an external power supply to power the immersive display 100.

The systems and subsystems that interact with the main processor 102 andare described herein are provided as examples only. Other subsystems 130may also interact with the main processor 102.

Utilizing the images from the internal camera 116, the main processor102 may be operable to track eye motion. To track eye motion, the user'spupils may be tracked when the immersive display 100 is in use. The eyemotion tracking may also facilitate determination of what a user islooking at, for example, by triangulation to determine depth of anobject or image that is user is looking at. Alternatively, the internalcamera 116 may identify or track changes in muscles or muscle motionaround at least one of the user's eyes to identify movement of the eye,or may track changes in shape of a lens of an eye or changes in shape ofthe lens of each eye to identify a focal distance, facilitatingidentification of the depth of focus of a user.

Based on the eye motion tracking, the direction that the user is lookingmay be identified. The direction may be, for example, an angle orangles, such as angular offset or offsets from straight ahead. Thus,when a user glances upwardly, downwardly, or to either side, thedirection is identified and the images displayed utilizing the display108 may be changed or adjusted based on the direction.

The eye-motion tracking may be utilized in association with one or morevision correction programs utilized by the main processor to effectuateeffective vision correction for the user. Such tracking may be utilizedto determine where in the visual field the user is looking and how theuser's eye or eyes are reacting to visual stimuli in order to provideappropriate image correction for a user's vision with respect to visualinformation provided to the immersive display 100 from the externalcameras 114 or other visual images displayed on the display 108. Depthof field information may be provided to the main processor 102 withrespect to objects viewed via the display 108 through the use of theexternal cameras 114. Such depth of field information may be provided tothe main processor 102. Such depth of field information may also beprovided to the main processor 102 by one or more devices associatedwith the immersive display 100 that provide a signal, such as a radiosignal, and a reflected signal detection device or devices configured toprovide range finding of objects in the field of view of the externalcameras 114. Thus, a user of the immersive display 100 configured with(1) sight correcting programming that adjusts displayed information inaccordance with a user's vision correction prescription or as otherwisedesired or required to correct a user's eyesight, and (2) additionaldepth of field focus components as indicated above can use the externalcameras 114 and the display 108 associated with the immersive visualdisplay so configured as a substitute for corrective eyeglasses or othercorrective eyewear.

The main processor 102 may be provided with one or more programs toconfigure the immersive display to determine the user's vision qualitystatus. Such programs may be utilized, for example, in association withthe above-noted eye tracking features to determine the amount ofcorrection of visual images displayed on the display 108 of theimmersive display 100 in order to provide clear images to the userwithout the use of prescriptive eyewear.

The external cameras 114 may include night vision cameras. Night visionimages from such night vision cameras, which images tend to bemonochromatic, may be appropriately color corrected utilizing colorcorrection software to provide a user with colorized images displayed onthe immersive display in low light situations.

The main processor 102 is also operable to receive the image data fromthe external cameras 114 and to transmit the data to the otherelectronic device, along with metadata for at least key frames foridentifying the image data such that the images can be stitched togetherto provide images of the user's surroundings. Thus, the images from eachof the cameras can be stitched together to obtain images of the user'sentire surroundings. Similarly, sound data can be utilized to providesound from the user's entire surroundings.

A plurality of immersive displays 100 may be utilized in conjunctionwith one another to record or transmit a panoramic or surround-type ofrepresentation of real world visual, audio, or audio and visualinformation. When a recording or transmission is intended to capture ascope of coverage, for example, 360 degrees, 270 degrees, or other, themain processor 102 may be configured to provide to the users of theimmersive displays 100, cues or other warnings or other indicators, suchas visual indicators displayed on the display 108 of the immersivedisplay 108, that show the user where to direct the immersive display100 in order to capture and provide images and other information forthat user's immersive display's contributive portion of recorded ortransmitted information. Thus, the immersive displays 100 may each beprovided with cues, warnings, or indicators to direct each user ofimmersive displays 100 such that together, the plurality of immersivedisplays 100 acquire the desired scope of coverage of recording and ortransmission. For example, a first user among three users, may beprovided with a graphic representation on the display 108 of the user'simmersive display to dynamically indicate a zone or region where theimmersive display 100 should be directed to capture images and otherdata utilizing the external cameras 114 and other input devices.Similarly other users may each receive a respective graphicrepresentation on their respective displays 108. The three userstogether may capture, via the external cameras 114, images or visualdata extending 360 degrees around the users. Thus, in this example, eachuser is provided with a visual cue to facilitate direction of theexternal cameras 114 of each of the three immersive displays 100 suchthat together, the three immersive displays 100 obtain sufficient datato obtain images that can be stitched together to provide a 360 degreepanoramic representation of the visual information for recording ortransmission or both recording and transmission.

A flowchart illustrating a method of displaying images on a display ofan immersive display is shown in FIG. 2. The method may be carried outby software executed, for example, by the main processor 102. Coding ofsoftware for carrying out such a method is within the scope of a personof ordinary skill in the art given the present description. The methodmay contain additional or fewer processes than shown and/or described,and may be performed in a different order. Computer-readable codeexecutable by at least one processor of the portable electronic deviceto perform the method may be stored in a computer-readable medium, suchas a non-transitory computer-readable medium.

As indicated above, the immersive display 100 may obstruct or block theuser's vision of his or her surroundings in order to immerse the user inthe environment projected utilizing the display 108. Thus, objects thatare near the user or in the way of the user when the immersive displayis utilized may be obstructed by the immersive display. For example, foran immersive display that is worn on the head of the user, hazards orobjects that are near or approaching the user may not be visible orapparent to the user.

The main processor 102 receives information from the exterior of theimmersive display 100. The information may be information obtainedutilizing the external cameras 114 and the proximity sensors 122 at 202.Based on the images obtained utilizing the external cameras 114 and theproximity sensors 122, the immersive display 100, detects objects thatare near the user or that are approaching the user.

In addition, to the information obtained using the external cameras 114,and the proximity sensors 122, the information may be informationobtained from, for example a peripheral accessory such as a glove, or asock that is equipped with a proximity sensor or proximity sensors andis in communication with the immersive display 100 via the short-rangecommunications 126. Thus, gloves or socks that may be worn by the userto track movement of the hands or feet of the user may also be utilizedto provide proximity information to the main processor 102. The glovesor socks may also be equipped with haptic feedback devices such aspiezoelectric actuators, or vibrational devices to provide the user withfeedback based on the locations of the user's hands or feet. In oneaspect, the illusion of reality may be furthered by creating anartificial environmental element, such as a virtual “seeing eye dog”,that would accompany other feedback received from the immersive display100. For example, to indicate an object ahead and to the right, thevirtual dog may appear to “tug” the leash on the user's right hand andthe user's glove tightens accordingly. The peripheral accessory or aplurality of peripheral accessories may provide such proximityinformation to the main processor 102 via wireless transmission.

The peripheral accessory or accessories may be utilized in associationwith information provided to the main processor 102 regarding the rangeof motion of the user's limbs or other body parts is obtained and usedin association with the object detection described herein. Such range ofmotion information may be utilized by the processor 102 in associationwith detection of the location of the user's limb or limbs or other bodyparts using one or more peripheral accessories in association with oneor more collision avoidance programs to provide warnings to the userthat movement of such user's limbs or other body parts may collide withone or more objects located within a region associated with such rangeof motion. Visual information may be displayed, via the display 108,indicating the area or areas that are displayed and that correspond tothe area or areas that are within such region or regions. Such areas maybe displayed with an identifiable display attribute, such as a red hue,for example

Object attributes are determined at 204. The object attributes includethe distance of the object from the immersive display 100 or from theperipheral accessory. The object attributes may also include the rate ofchange of the distance between the object and the immersive display 100or the velocity of the object and the rate of change of the velocityover time. Thus, the immersive display 100 may identify that anobstruction is near the user based on proximity of the obstruction, andmay identify what the obstruction is. For example, the immersive display100 may identify stationary objects such as a table, a chair, a wall,stairs, a cat, a dog, or any other object that is in close proximity tothe user. The immersive display may also identify objects that areapproaching the user, such as a car, a bicycle, or other moving objectthat is moving towards or in a direction that will cause the object tomove near the user.

Object attribute information may be obtained from remote databases. Forexample, object image information may be transmitted by the immersivedisplay 100 to a remote processor that utilizes such information todetermine what the object is through the use of object recognitionsoftware such as the type developed by Google, Inc. Informationregarding object identification, and other information regarding theobject may then be provided to the immersive display 100 for displayutilizing the display 108.

Objects that are within a threshold distance are identified at 206. Thethreshold distance may vary based on any suitable factor, including thelocation of the object, the type of object, and the object attributes.For example, the threshold distance for stationary objects may be lower,or a shorter distance, than the threshold distance for objects that aremoving relative to the user, such as an object travelling towards orapproaching the user. Furthermore, the threshold distance may be greaterfor objects that are moving towards or are approaching the user at agreater velocity.

The threshold distance may vary based on direction of the objectrelative to the orientation of the user. For example, the thresholddistance may be greater for a stationary object that is in front of auser than a stationary object that is behind a user.

The threshold distance may also vary based on the object. For example,the threshold distance may be greater for a car approaching a user thanfor a person approaching a user.

The threshold distance may be calculated based on any suitable factor ormay be identified from stored threshold values, for example, from alookup table. Objects that are within the threshold distance ordistances are identified for display at 206. An object may not beidentified at 206 when the object is a sufficient distance away. Forexample, the main processor 102 may only identify a stationary objectthat is within a few meters of the external cameras 114 or may onlyidentify a car or bicycle when the car or bicycle is within 20 meters ofthe external cameras 114.

When an object is identified at 206, i.e., an object is within athreshold distance, the method proceeds from 208 to 210. When no objectsare identified, the method returns to 202 and information regarding theuser's surroundings is obtained again utilizing, for example, theexternal cameras 114, the proximity sensors 122, and a peripheralaccessory or accessories.

Optionally, the line of sight of the user is identified at 210. The lineof sight of the user may be identified based on the direction of theuser and by tracking eye motion utilizing the internal camera 116 whenthe immersive display 100 is in use. Thus, the direction that the useris looking may be identified. The direction may be, for example, anangle or angles, such as angular offset or offsets from straight ahead.

A representation of the object is displayed on the display 108 at 212 ata location on the display 108 that corresponds with the location of theobject relative to the external cameras 114. Thus, for example, arepresentation of an object that is directly in front of the user, at adistance of 3 meters, is displayed such that the displayedrepresentation of the object appears to be directly in front of theuser, at a distance of 3 meters. The representations that are displayedmay optionally depend on the direction that the user is looking withinthe immersive display 100 to give the user information about thedirection of objects or hazards in front of the user or in the directionthat the user is looking. By displaying the representations of objectsin such a way that the user can easily distinguish between therepresentation and virtual reality, hazards are identified and are notmistaken for virtual reality, reducing the risk that a user may ignoresuch displayed elements. Optionally, the displayed content may include amirror, such as a rearview mirror for displaying representations ofobjects that are behind the user. Thus, a user can glance upwardly intothe rearview mirror to see representations of objects that are behindthe user. Side mirrors may also be displayed for displayingrepresentations of objects.

The representation of the object is displayed in such a way todistinguish between virtual reality displayed on the display 210 and therepresentation of the object. Thus, the attributes of the representationdistinguish the object from the virtual reality images displayed on thedisplay 108. For example, the representation may be displayed as awireframe representation layered or superimposed on the virtual realityimages that are displayed. The representation may be displayed in acolor or contrast that distinguishes the representation from virtualreality such that the user can easily identify that the representationis not part of the virtual reality that is displayed on the display 108.

Optionally, the display attributes of the representation may bedependent on the distance of the object from the user. For example, asthe user moves closer to the object or as the object moves closer to theuser, the color may change, the brightness may change, or the displayedrepresentation may transition from a transparent wireframe to an opaqueobject. In one example, the color changes from a green wireframe to anorange wireframe when the distance to the object decreases from greaterthan a threshold distance to within the threshold distance.

The display attributes of the representation of the object may also bedependent on the velocity or the change in velocity over time. Forexample, a car that is 30 meters away and that is moving towards a userat 30 kilometers per hour may be displayed in a different color than acar that is 30 meters away and that is moving towards the user at 5kilometers per hour.

Optionally, the main processor 102 may stitch together images from theexternal cameras 114 and may display the user's environment orsurroundings, thereby interrupting the display of the virtual realitywhen the user is very close to, or within another threshold distance ofan object such that when the user is in danger of bumping into, fallingdown, stepping on, or being hit by the object, the virtual reality isinterrupted to display the user's surroundings. Thus, multiplethresholds may be utilized for an object, for example to determine whento display a representation of the object, to determine the displayattributes of the representation, and to determine when to interruptdisplay of virtual reality. A first threshold may be utilized todetermine when to display a representation of an object by superimposingthe image on the virtual reality. Another threshold may be utilized todetermine when to interrupt the virtual reality by displaying an imageof the object. Other thresholds may also be utilized that areintermediate the first threshold and the threshold that is utilized todetermine when to interrupt the virtual reality. The other thresholdsmay be utilized to change attributes of the displayed representation ofthe object depending on distance from the object.

In one example, a wireframe representation of a table is shown as a usernears a table. The displayed representation may be very faint when thedetermined distance is, for example, two meters from the table. When thedistance is within a meter of the table, the representation is brighterand is displayed with lines of greater thickness. When the distance isless than 30 centimeters, the virtual reality is interrupted and theuser's surroundings are displayed on the display 108. Thus, therepresentation is distinguished from any part of the virtual realitythat is displayed.

In another example, a wireframe representation of a motorcycle anddriver is shown in a rearview mirror displayed on the display 108 when amotorcycle is behind the user. The displayed representation may beyellow when the motorcycle is 60 meters away and is moving at a speed ofa few meters per minute. When the speed of the motorcycle increases, forexample, to 20 kilometers per hour, the wireframe representation changesfrom yellow to red. When the motorcycle speed increases to 40 kilometersper hour, the virtual reality is interrupted and the motorcycle anddriver are displayed in the rearview mirror on the display.

In another aspect, the virtual reality environment may include a virtualheads-up display. Taking Google Glass™ as an example, a virtual versionof the Google Glass™ display, namely a small display in the upper rightcorner of the right eye's field of vision may be displayed. The virtualheads-up display may, in this example, display an image of the realenvironment, based on the images from the external cameras, within thevirtual environment. By providing an easy method for the user to viewthe real environment without leaving the virtual environment, the usercan validate the immersive display warnings. In one aspect, this reducesthe risk that a virtual element is displayed, maliciously orunintentionally, that emulates a hazard or obstacle warning. In anotheraspect, the immersive display may filter out virtual objects, or alterthe display of such objects, for virtual objects that are within athreshold distance, to reduce the chance that a user may mistake thevirtual objects for representations of real objects that pose a hazard.

The relative mix of the display and/or generation of real world visual,audio, or haptic information provided to the processor 102 utilizing theexternal cameras 114, microphones 118 and/or haptic devices and visual,audio or haptic information provided to the processor 102 by othermeans, such as by recorded information, which may be virtual worldcontent, may be adjusted by the user, may be automatically adjusted, ormay be adjusted both automatically and based on user adjustments. Forexample adjustment of the relative amounts of real world and recordedinformation displayed enables the user to comfortably set the relativeamount of surrounding real world information provided in associationwith other displayed information suitable for the user.

The processor 102 may access and use one or more remote collisionwarning and collision avoidance systems. For example, the immersivedisplay 100 may be configured to associate or interact with one or moreof an automobile collision warning system and collision avoidancesystem.

The immersive display 100 may be embodied in one or more configurationsdesigned to look like ordinary sunglasses.

The described embodiments are to be considered as illustrative and notrestrictive. The scope of the claims should not be limited by thepreferred embodiments set forth in the examples, but should be given thebroadest interpretation consistent with the description as a whole. Allchanges that come with meaning and range of equivalency of the claimsare to be embraced within their scope.

What is claimed is:
 1. An immersive display apparatus, comprising: anapparatus body; at least one input device operably connected to theapparatus body for detecting objects in at least one region outside theapparatus body; a display inside the apparatus body for displaying avirtual image thereon; and a processor coupled to the input device andto the display and operable to: receive information from the at leastone input device; determine attributes of a real-world object, includingat least a first distance to the real-world object; and in response todetermining that the first distance to the real-world object is within athreshold distance, display a wire frame representation of thereal-world object.
 2. The apparatus of claim 1, where a color of thewire frame representation of the real-world object varies based on athen-current distance to the real-world object.
 3. The apparatus ofclaim 1, where a size of the wire frame representation of the real-worldobject varies based on a then-current distance to the real-world object.4. The apparatus of claim 1, where the wire frame representation isdisplayed in a color or contrast that distinguishes it from othercontent being displayed on the immersive display apparatus.
 5. Theapparatus of claim 1, where the color of the wire frame representationof the real-world object varies based on a then-current speed of thereal-world object.
 6. The apparatus of claim 1, where a warning messageis also displayed.
 7. The apparatus of claim 1, where the wire framerepresentation transitions into a different object as a proximity to auser changes.
 8. The apparatus of claim 1, where the apparatus furthercomprises an operably connected haptic device.